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ABSTRACT 


Landings by experienced airline pilots transitioning to the DC-10, per- 
formed in flight and on a simulator, were analyzed and compared using a pilot- 
in- the-loop model of the landing maneuver. By solving for the effective 
feedback gains and pilot compensation which described landing technique, it was 
possible to discern fundamental differences in pilot behavior between the ac- 
tual aircraft and the simulator. These differences were then used to infer 

simulator fidelity in terms of specific deficiencies and to quantify the ef- 
fectiveness of training on the simulator as compared to training in flight. 
While training on the simulator, pilots exhibited larger effective lag in 
commanding the flare. The inability to compensate adequately for this lag was 
associated with hard or Inconsistent landings. To some degree this deficiency 
was carried Into flight, thus resulting in a slightly different and inferior 
landing technique than exhibited by pilots trained exclusively on the actual 
aircraft. 
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AR ANALYSIS OP AIRLINE LANDING FLARE DATA 

BASED ON FLIGHT AND TRAINING SIMDLATOR MBASOREMENTS* 

Robert K. Heffley, Ted M, Schulman, Robert J. Randle, Jr. 
and Warren F. Clcnent 
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SUMHARY 


An analysis of pilot behavior, taken both from an airline training simula- 
tor and an actual DC- 10, Is presented for the landing maneuver. An emphasis Is 
placed on developing a mathematical model in order to identify useful metrics, 
quantify piloting technique, and define training effectiveness and simulator 
fidelity* On the basis of DC-10 flight measurements recorded for 32 pilots — 
13 flight-trained and the remainder simulator-trained — a revised model of the 
landing flare is hypothesized which accounts for reduction of sink rate and 
preference for touchdown point along the runway. The flare maneuver and touch- 
down point adjustment can be described by a pitch-attitude-command pilot 
guidance law consisting of lead-compensated height feedback. The pilot gain 
and compensation, which are identified directly from the flight and simulator 
data, show that the flare is being executed differently in each of the two 
media. In flight roost of the subject pilots exhibit a near-optimum effective 
lead-lag combination which Is essential for well controlled sink rate reduction 
over a wide-range of response bandwidths. In the simulator, however, the com- 
pensation appears to be compromised by excessive lag which leads to 
substantially Inferior landing performance. This Inferior simulator technique 
appears to have an unfortunate carry-over into at least the first fsw actual 
landings performed by those pilots trained solely on the simulator. The in- 
appropriate piloting technique observed in the simulator implies a simulator 
fidelity and validity problem, and several specific possibilities are dis- 
cussed • 


INTRODOCTION 
Study ObJfjctives 

The purpose of this study was to focus on the landing maneuver as it is 
performed both in flight and In an airline training simulator in order to: 


♦Performed unde '^ASA Contract NAS2-10817. 
♦♦NASA, Ames Reseat i Center. 
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!• Measure absolute differences between pilot-vehicle 
behavior exhibited on the simulator versus that exhibited 
in flight, 

2* Develop a landing maneuver performance metric, 

3- Define how to use such a metric in both simulator and 
flight. 


Objectives of the Data Analysis 


The data base used in this analysis was collected during a NASA field eval- 
uation of the sole use of simulator training in transitioning airline pilots to 
a new aircraft type (Ref. 1). The unique aspect of the data acquired is that 
they involve both actual flight and simulator measurements for a reasonably 
large number of pilots. Furthermore specific attention was devoted to making 
the flight and simulator data directly comparable in terras of pilots, aircraft, 
and environmental conditions. 

The procedure used in analyzing the available data was based on manual 

control theory (Ref. 2) which treats human psychomotor and cognitive behavior 
as rational, well-tailored actions dependent upon the Cask, vehicle dynamics, 
and environment. These actions can be essentially closed loop and compensatory 
in nature or progressively more open loop and precognitlve depending upon the 
s level of skill or workload demands. The technical approach is de- 

scribed in more detail below* 

The issue of simulator fidelity has been stated in terras of manual control 
theory in Ref. 3 and is highly relevant to the analysis. In fact, perceptual 
fidelity is addressed in terms of "essential cueing" as discussed in Ref. 4. 
As will be seen, there is evidence that the training simulator involved In this 
study is somehow deficient In Inducing the pilot behavior observed in flight. 

Flight training Is another topic considered in this report since Chat was a 
prime objective of the program which produced Che data base. If training is 
viewed as the development of essential loop structure which describes psycho- 
motor and cognitive behavior of the Cask-pilot-vehicle system (Refs. 3 and 5), 
Chen Che analysis results presented should serve to quantify some aspects of 
the transition training Imparted to Che pilots. Furthermore, as a result of 
quantifying pilot-vehicle loop structure, a means of viewing the transfer of 

training from simulator to flight should ensue. This means may be a useful 

training tool In itself* 
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Background of the Data Acqulaltion Effort 


The use of flight simulators as substitutes for aircraft in airline pilot 
training has increased dramatically during the current era of the jet trans- 
port. A series of changes and exemptions to the Federal Air Regulations (FARs) 
to allow the increased use of simulators in training has culminated in the 
current regulation for advanced simulation (FAR 121, Appendix H) , which defines 
the requirements for total simulation training and checking. this regulation 
defines three phases of simulator upgrade, each allowing progressively more 
critical types of training to be accomplished in the simulatct, so that in the 
final phase, all pilot training and checking may be done in the simulator. 

The simulator upgrade requirements Include hardware improvements to in- 
crease the fidelity of the motion and visual systems and software improvements 
to provide more realistic representation of aerodynamics and ground handling. 
Also required, although less well defined, are changes in the simulator train- 
ing programs or in the ways simulators are used, including requirements for 
llne-orlented flight training (simulation of complete missions and mission 
segments) and increased training requirements for simulator Instructors and 
check airmen. These latter requirements reflect recognition of the goal of 
Implementing the regulation: There must be complete confidence in the ability 
of instructors and check airmen to predict a pilot's performance in the air- 
plane from his performance in the simulator. 

In spite of the previously demonstrated value of the simulator in training, 
complete confidence In simulator training, in the absence of an airplane check, 
may require that increased attention be given to the validity and reliability 
of pilot proficiency assessment during training and checking. Proficiency 
assessment will have to be made more objective and standardized to increase its 
validity and reliability. Any significant contribution that can be made in 
this area should increase confidence in simulator training and checking. 

In anticipation of the advanced simulation regulation, the United Airlines 
Training Center and the Man-Vehicle Systems Research Division of NASA's Ames 
Research Center, encouraged by the Air Transport Association's Simulator 
Training Task Force, conducted the study of total simulator training first 
reported in Ref. 1. The study was limited to transition training (pilots mov- 
ing to a new aircraft) of captains and first officers. Under the regulation 
for advanced simulation, transition training is permitted only after simulator 
upgrade according to Phase II of the regulation, although the study was con- 
ducted on simulators that would qualify only for Phase I. Therefore the test 
of the simulators for training was more severe than would be allowed under the 
regulation. However, to insure safety in the study and on the line after the 
study, an airplane check and (if needed) airplane training were provided after 
the exclusively simulator training. 

The purpose of the study (of Ref. 1) was to evaluate a transition training 
program that replaced the airplane with a state-of-the-art flight simulator. 
The evaluation procedure Involved analysis of various objective measures and 
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ratings of pilot performance as a step toward objectifying and stan- 

perfonwnce In a standard check ride (FAR 121, Appendix F) of pilots*^ trained 

l^tht a*lrni the performance of pilots trained partlallj 

far 121. Appendix E. Performance measures 
used In the evaluation and reported In Ref. 1 were: (a) check-pilot pass-fall 

ratings; (b) check-pilot ratings of specific check-ride segments; (c) a NASA- 
e^loyed observer's rating of specific maneuvers; (d) tralnS^ ratings oJ tJfJr 
own performance and of the training they received; and (f) automatically mea- 
sured system variables. The statistical analysis of these data was designed to 

trllMd’^nn J*'* simulator-trained with that of the alfplane- 

tralned pilots; (b) identify any anomalies peculiar to the performance of the 
simulator-trained pilots; and (c) explore the possibility of developing a pre- 
dictive equation of pilot performance that in the future might L used ®o 
support training and checking. ® 

reported herein Is. In effect, an extension to the orlg- 
"’"•‘O"*''* .ddltlon.! ..tries »iy, ot 


Technical Approach 


is earlier the technical approach applied to this analysis effort 

V j Ju ^ nianual control theot;r of human psychomotor and cognitive be- 

havlor. The specific area studied Is the landing maneuver in the vertiLl 

ls^on'thr»rJ' aspects are not considered. Furthermore the focus 

is on the ^ter loop aspects of the landing, l.e., control of flight path and 
position. The inner loop" regulation of pitch attitude is recognized but Is 
^ooDs**^ understood and can be partitioned from the outer 

thari.lpJri- \ attitude Is routinely viewed as the "control" rather 

M 1 control column deflection, per se. This greatly simplifies 

t e vehicle dynamics and helps to focus on only those airframe parameters which 

LtaneTa " «-«theless carrying aTong a cLpUte 

etalled description of the pilot and aircraft Is not precluded If that^were 
necessary* 

specific steps In the technical approach are reflected In the report 
organization and include: 



• A preliminary examination of the experimental results and 
data obtained 

• Development of a mathematical model of the landing man- 
euver and theoretically derived metrics 

• Analysis of the flight and simulator data In mathematical 

model terms and discussion of findings. 
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The first of these steps involved a cursory inspection of the landing data In 
order to gain an appreciacion of the Infonaatlon available and how the data 
could be Improved cr augmented by smoothing or estimation procedures. In ad- 
dition the flight data were carefully reviewed in order to revise old modeling 
notions or to formulate new ones. 

Next the development and statement of a mathematical model was considered 
after a review and discussion of earlier modeling attempts. As will be seen, 
the flight data provided new insights into the nature of the landing maneuver, 
but the net result was a reduction in complex! ty~“not an increase. A presenta- 
tion of model features in Appendix B leads to the choice of an equivalent 
pilot-vehicle system model having a limited number of degrees of freedom com- 
mensurate with the paucity of flight data. The discussion of the selected 
pilot— vehicle system model appears in the text under the topic Flare Model 
and leads natu -lly into consideration of performance metrics which character- 
ize both the landing maneuver and the pilot-vehicle system. The aim was to 
point out or clarify relationships among the many metrics cited rather than to 
promote a favored metric. 

The presentation of analysis results is made primarily in terms of the 
closed-loop response parameters identified from landing phase plane portraits 
of sink rate plotted against altitude. The numerical results provide, in terms 
of the metrics established, a basic definition of the nominal piloting tech- 
nique, the effects of flight versus simulator training, and the effective 
simulator fidelity in these circumstances. 

The key ideas behind the approach taken here were (a) to recognize the net, 
overall behavior of the closed-loop pilot-vehicle system, (b) to factor out the 
known essential physical behavior of the aircraft, and (c) to infer from what 
is left the likely actions of the human pilot. The guides for this process 
consist of all available descriptive material concerning the task, aircraft, 
environment, and pilot. 



SYMBOLS 


Z®. Wing aspect ratio 

a Real component cf frequency for the flare maneuver also 

constant in complementary filter formulation 

b Damped frequency of the flare maneuver 

C Cl Coefficients of the regression line defined by F.q. 10 and presented 

o * 1 

in Table 5, p. 66. 

C, Maximum lift coefficient 

Siax 

C. Non-dimensional lift curve slope 

^<x 
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e 


Naperian hase, 2.7182*** 


f Thrust 

g Gravitational acceleration (• 32.2 ft/sec^ or 19 kt/sec) 

H Absolute height 

h Perturbed height Tusually equal to absolute) 


H 

h 

m 

h 

H 

h 

I, 




k' 

Y 

(L/D) 


max 


xn 


Absolute vertical velocity 

Perturbed vertical velocity 

Estimated vertical velocity 

Absolute vertical acceleration 

Perturbed vertical acceleration 

Pitching moment of inertia 

Pilot's effective height gain 

Pilot's effective vertical velocity gain 

Pilot's effective flight path angle gain 

Pilot's composite flight path angle gain, + Ukf, + ... 

Maximum llft-to-drag ratio 

Fuselage length 

Matural logarithm 

Speed margin above stall 

Aircraft mass 

Perceptual preview distance 
Wing area 
Laplace operator 
Effective lag time constant 





Effective lead time constant 


Effective height lead time constant of pilot 
Airspeed response tine constant 


t 

u 


u 



a 


Y 

A 

At 


^FL 


0 


0 

^GS 

T| 

‘•‘fl 


Flight path response time constant 
Time 

Velocity vector along x-axls 
Perturbed x-axls velocity (airspeed) 

Airspeed (■■ U) 

(1) Velocity vector along z-axis; (2) gross weight 
Pilot's effective acceleration transfer function 
Angle of attack 
Flight path angle ( •» h/U) 

Prefix denoting Incremental quantity 

Incremental lag associated with discrete pitch attitude commands 
Column displacement 
General state variable 

Effective damping ratio of landing maneuver 

Absolute pitch attitude 

Perturbed pitch attitude 

Glide slope angle 

3.14159... 

Air density (• 0,002377 slug/ft^) 

Height phase margin 

Effective undamped natural frequency of landing maneuver 
Pitch attitude crossover frequency 
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“<=h 

Height crossover frequency 

“p 

Phugoid frequency 


Subscripts 

c 

Coimnand 

FL 

Flare 

max 

Maximum 

o 

Initial condition 

TD 

Touchdown condition 


Abbreviations 

a eC. 

Aerodynamic center 

eg 

Center of gravity 

FAA 

Federal Aviation Administration 

FAR 

Federal Aviation Regulation 

MVSRF 

Man-Vehicle Systems Research Facility 

STI 

Systems Technology, Inc. 


METHOD OP ANALYSIS 

Description of Experlaental Design and Data Obtained 


Paeilitles. The study from whence the data base was obtained was accom- 
plished at United Airlines Flight Training Center In Denver, Colorado. To 
enhance the generality of the results, two types of airplanes were Included In 
that study: the Boeing 727 and the Me Donne 11-Doug las DC-10; but only the DC-10 
results are considered in this analysis. (Reference 1 Includes results for 
both aircraft types.) 

The aircraft involved In the collection of data were unmodified McDonnell— 
Douglas DC-10-10 wlde-body jet transports. Gross weight at landing ranged from 
270,000 to 140,000 lb. (A nominal value of 300,000 lb was assumed for analysis 
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purposes.) Normal landing procedures are described In both the manufacturer s 
and airline's flight manuals (Refs. 6 and 7), the latter la more explicit In 
terms of nominal attitude excursions and height of flare Initiation. 

Flight training and check rides were conducted primarily at Denver s 
Stapleton International Airport. The normal approach was made on the instru- 
ment landing system (ILS) for Runway 34R; however, visual meteorological 
conditions prevailed. Due to aircraft availability, most if not all of the 
flights were made at night. 

The United Airlines DC-10 simulator (No. 605) was used for pilots transi- 
tioning to the DC-10. The simulator was a Redlfon DC-10 system with a moving 
base and outside visual scene. Relatively large amplitude vertical motion was 
provided by a "Synergistic” type of motion platform characterized by a pendulum 
support structure. A Redlfon NOVOVIEW visual system was used to display a 
36 deg by 48 deg fleld-of-vlew computer-generated Image of a nighttime runway 
environment. No details were available on motion or visual simulator response 
characteristics or • thematical model software and digital computer Implementa- 
tion. Therefore judgment Is reserved on specific sources of any of the 
simulator fidelity effects which are measured In the data. The aerodynamic 
model was, however, upgraded to comply with Phase 1 of FAR 121, Appendix H. 
This Included modification of the ground effects model. This simulator thus 
received approval by the Federal Aviation Administration (FAA) for simulator 
training of the landing maneuver. Except for the special provision that the 
study trainees receive all of their simulator training on an approved upgraded 
simulator, all of the training center facilities used In normal training were 
used In the study. 

Trainees. Captains and first officers arriving at the training center for 
transition training to the DC- 10 were selected on a random basis to be part of 
the study or to receive normal transition training and checking according to 
FARs 61 and 121 (Including Appendices E and F). Those trainees selected for 
the study were randomly assigned to either the excluslve-slmulator-tralnlng 
(experimental) group or to the normal training (control) group. Occasionally 
simulator availability modified the random assignment of trainees to the 
study. This modification to the study procedure was necessary to minimize 
disruption of the regular flow of trainees of all types through the training 
center. Also, for a variety of reasons Including simulator and airplane avail- 
ability, some pilots originally assigned to the study had to be dropped later, 
in which case they became normal transition trainees. These will be discussed 
In more detail later In the report. A total of 87 pilot trainees, transition- 
ing to the nC-10, completed the study, 34 captains and 53 first officers. Data 
are analyzed In this report for 32 of these trainees. 

Procedure. Trainees of both the experimental and control groups received 
normal ground school and simulator training In the appropriate landing-approved 
simulator without being Informed of the.r gr*-up status. After passing their 
normal simulator check, the control-group trainees progressed, as routinely 
done, receive Appendix E (FAR 121) training In the airplane. Appendlx-E-type 
training will he referred to as landing training since landing la considered to 
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he the most critical part thereof* Trainees In the experimental group received 
their landing training In the landing-approved simulator. The simulator land- 
ing training course was developed by personnel of ttie training center and was 
designed to duplicate as closely as possible the standard landing training 
receive! by the control group In the aircraft. 

Trainees next proceeded to the NASA check ride. For many In the experi- 
mental group* the NASA check ride was their first experience at the controls of 
Che DC-IO. The NASA check ride was designed to simulate the normal check ride 
that would result In certification of the trainee to fly the new airplane type 
in revenue flights. A United Airlines check pilot served In his normal capa- 
city in checking the first officer trainees and In simulating the role of an 
FAA check ride Inspector on the basis of availability. The check ride con- 
sisted of the maneuvers specified In »=*AR I2t* Appendix F, plus one additional 
normal landing in the following sequence: (a) taxi; (b) normal takeoff; 
(c) VFR approach without Instrument guidance; (d) normal full-stop landing; 
(e) normal takeoff; (f) hooded approach, one engine Inoperative; (g) missed 
approach; (h) VTR approach, one engine Inoperative, Instrument g\ildance avail- 
able; (t) englne-out landing, touch-and-go; (j) VFR approach without instrument 
guidance; and (k) normal landing. The second normal \TH landing was added to 
provide additional dvata. 

Upon completion of the final maneuver, the check pilot had the option of 
requiring or offering additional practice In the airplane before completion of 
the flight. This option was almost Invarlahlv exercised regardless of the 
trainee's performance on the check-ride maneuvers. In order to maintain his 
responslhi li t V as safety pilot, the check pilot did not interrupt his monitor- 
ing of the flight to record his ratings of the trainees' p:erformance until 
after the additional practice; however, it was understood chat his ratings were 
to he based only on the check-ride maneuvers. 

To g\iard against bias in their ratings, the check pilots were not told 
prior to their ratings whether the trainee had received the landing training In 
the airplane or the simulator; thar Is, thev were not told to which group the 
trainee belonged. 

Throughout the check flight the NASA observer sat in the Jump seat directly 
behind the captain's seat. The observer was one of two retired Ignited Airlines 
captains who worked under contract with Ames Research Center. The observer's 
responsibility was basically to supervise data collection. In addition to 
scoring his ovm rating sheets, he installed and actuated the automatic data 
recording system on the airplane, and Issued and collected the racing sheets of 
the check pilots and trainees. The observer's ratings consisted of instrument 
recordings and evaluative Judgments made during the various maneuvers. A two- 
axis accelerometer was mounted on the cabin floor over the airplane's center of 
gravity. Vertical and lateral accelerations were recorded on an FM cape re- 
corder starting during the approach at an altitude of 200 ft. Simultaneously, 
altitude was recorded frivn the airplane's radio altimeter. During Phase IT, 
similar automatic recordings were also taken In the simulator. 


in 




FolJowlng the check ride* the trainee completed a questionnaire about his 
flying history and made ratings of both his performance in the check ride and 
of how well he thought his training prepared him for the check ride. 

After the check ride* all of the collected data remained in the custody of 
the NASA observer until it was mailed to Ames Research Center* %ihere it was 
analyzed. The data packages had no identifying trainee names; trainees were 
identified by numbers only. 

The study was completed for the trainee when the NASA check ride was com- 
pleted. Additional training was then given to all trainees. First officers 
were then certified* and captains proceeded to the FAA check ride. 

The kinds of data obtained for the landing maneuver were somewhat different 
between the aircraft and the simulator. Flight data were necessarily sparse 
because of Instrumentation limitations and restrictions. For the simulator a 
reasonably wide range of data were accessible. Data analysis and comparisons 
were therefore constrained mainly by the flight data. 

A portable NASA instrumentation package was placed aboard the various DC- 10 
aircraft used for training. This package recorded: 


• Vertical acceleration 

• Lateral acceleration 

• Radio altitude (production installation) 

• Time 


Analog samples were recorded starting at about 200 ft and continuing well into 
the landing rollout. FM recordings were then transferred to a NASA PDP-12 
computer for the Initial analvses reported In Ref. I, giving smoothed data 
every *>0 ms. 

The simulator data Included most of the aircraft states and controls. They 
were : 


• Body axis translational accelerations 

• Bodv axis translational velocities 

• Vertical velocltv 

• Radio altitude 

• Pitch attitude 




It 




• Lateral and vertical glide slope deviations 

• Wheel, yoke, and rudder positions 

• Slant range to touchdown zone 

• Touchdown flag 

• Tine 


Samples were recorded every 200 ms starting at about 300 ft and continuing well 
Into the landing rollout. 

It should be noted that there Is a lack of symmetry In the data available 
for the two groups. Data were obtained for both the simulator training and 
check-ride phases for the simulator-trained pilots, but only for the check ride 
In the case of the f 1 Ight-tralned pilots. Data recorded by the MASA-observer 
during the check rides consisted of: 


• Gross weights 

• Computed reference airspeed 

• Flap settings 

»» Glide slope and speed deviations at specific altitudes 
o Touchdown distance from touchdown zone 

• Occasional landing specific comments about wind and tur- 
bulence conditions 


Data Preparation 


nature of Data. The longitudinal aircraft states and controls desirable 
for studying the landing maneuver are: 


a Pitch attitude 
a Pitch rate 
a Altitude 
a Vertical velocity 
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• Control column position 

• Range from threshold 


All of these variables are typically available from aircraft simulations but 
are more difficult to obtain from flight, especially when there is no 
experiment-dedicated aircraft and recording package. In the present case all 
of the above variables, except pitch rate, were recorded from the simulator, 
and only altitude and vertical and lateral acceleration were recorded from 
flight. Hence the flight measurements were the limiting factor In data 

analysis. Steps were taken to enhance the data by estimation and smoothing 
techniques. Estimation of vertical velocity and pitch attitude for the flight 
data met with mixed success as will be described. 

Approach. There are a number of different ways that flight data can be 
e?;aralned, each having Its strengths and weaknesses depending upon whit var- 
iables are to be considered. The study of piloting techniques In landing 
Imposes further constraints. Since the flare takes only about one quarter of a 
cycle of the predominant closed-loop flight path response mode, describing 
function Identification techniques are untenable. Terminal performance mea- 
sures, such as touchdown sink rate and distance from the touchdown zone, 
measure the outcome of a particular maneuver. Summary statistics can show 
trends In groups of landings or groups of pilots, but they do not tell why a 
particular maneuver succeeded or failed or If the technique Is a good one 
(l.e., will continue to result In good landings In spite of different wind 
conditions, turbulence levels, or deviations from reference airspeed). Also 
needed are ways of looking at the data which show "how the pilot got there" a. 
well as the final result Itself. Two such trays of displaying this Informat 
are (a) the time history and (b) the phase plane portraits or state varlaolc 
crossplots. Time histories, which are commonly used, are simply graphs of the 
variables of Interest versus time. State variable crossplots describe two 
variables of interest against each other, with time becoming an Implicit param- 
eter on the curves. (These curves are referred to as "trajectories," as 
following the curve In the direction of Increasing time shows the path through 
the state space.) Phase planes can have advantages over time histories when 
comparing repeated performance of a maneuver since they present the Information 
In a more concise form. For example Ref. 8 suggests one way of modeling the 
landing. It hypothesizes a proportional control law for pitch attitude which 
depends on height above the ground, extending from flare height to touchdown. 
Looking for this behavior directly In time histories Is difficult; because 
flare height, pitch attitude, and sink rate vary significantly from landing to 
landing, screening any Inter-relatlonshlp between states. On the other hand, a 
number of crossplots of pitch attitude versus height would reveal the above- 
mentioned hypothesis directly or perhaps suggest other relationships. 

Phase plane portraits are special cases of state variable crossplots. 
These are crossplots of a variable and Its derivative, such as altitude versus 
vertical velocity. As one variable la the derivative of the other. Important 
features of the dynamic response are visible. For example, a landing maneuver 
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tn which no ballooning r:.kes placo will produce a trajectory entirely in the 
right lower quadrant as this corresponds to a positive altitude and negative 
vertical velocity. 

The first step In the data reduction was to use the existing flight data to 
estimate those additional states desired. A constraint in the choice of 
methods was that the task was to study landing techniques, not techniques in 
state variable estimation. Without doubt it would be possible, using more 
sophisticated filtering and estimation techniques, to reconstruct desired 
states using the altitude and acceleration data. This was not performed, hov^ 
ever, due to constraints of time and computer resources. Simpler methods were 
used with good results, at least in estimating vertical velocity. Pitch atti- 
tude estimates were not adequate; but, as will be seen in the following 
sections, the lack of good pitch attitude information did not detract from the 
analysis. The following is a discussion of the estimation techniques used and 
how they were validated. 

The estimation of sink rate is easier than the estimation of pitch attitude 
as there is no need to consider the aircraft's dynamics. Complementary filter- 
ing was used to take advantage of all of the data available. The altitude data 
is appropriate for low-frequency estimation of sink rate, while vertical accel- 
eration is appropriate for high frequencies. Complementary filtering allows 
the data to be combined in a way that takes advantage of these relative 
strengths. The continuous form of the filter is: 


h 


a s 
s + a 


h 


+ 



( 1 ) 


"washed out" 
altitude 


"lagged" 

acceleration 


whe re 

s is the Laplace operator 
h is Che measured altitude 
h is the measured vertical acceleration 
h is Che estimated sink rate 
and a Is the characteristic frequency of the filter 

In the continuous case, with no noise, the Identities sh ■ h and h ■ sh can be 
substituted Into Eq. I, giving the Identity h - h. For a more complete discus- 
sion of complementary filtering, see Ref. 9. 
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The complementary filter was Implemented in finite difference equation form 


as: 



+ a h 

n 


a h 


n-l 




( 2 ) 


The characteristic frequency, a, of the filter was determined empirically 
to accommodate the sample period as well as the noise content of the measured 
altitude and vertical acceleration. Figure 1 shows four different values for 
a; 5, 2, I, and 0.6 rad/sec. The value of I rad/sec was chosen for use. 
Larger values produced too noisy an estimate, and smaller values began to In* 
troduce a noticeable lag and further attenuated the noise level only slightly. 

One Improvement to the estimation algorithm was made. For the plots shown 
In Fig. I, the portion of the filter that operates on altitude was initialized 
with a zero sink rate. This causes the estimate Initially to have a large 
variance. This problem was eliminated by using the average of the derivative 
of the altitude over the first ten points as the initial value. Computation 
was also halted at the previously computed touchdown point. The result of 
these changes is shown In Fig. 2. This method was validated using the simula- 
tor data. Estimates were made of the sink rate and the results compared 
favorably with the recorded values. 

All of Che plots In this report are labeled with the word **PIL0T,” followed 
by a letter and two numbers. The letter Indicates whether the data Is from 
flight (F) or simulation (S>. The first number (In the four hundreds for this 
report) Is the pilot identification number. Interpretation of the second num- 
ber depends upon whether the data are from flight or simulation. If Che data 
are from flight, the number Indicates the check ride landing number (I, 2, or 
3). If the data Is from simulation, the last two digits of the number Indicate 
the experimental run number on the magnetic tape and the first one or two 
digits indicate Che tape number. For example: 


PILOT F404/2 


indicates that the data were taken in flight, the pilot identification number 
Is 404, and the landing was the second in the sequence of three. 


PILOT S432/1308 


indicates that the data were taken on the simulator, the pilot Identification 
number Is 432, and the landing was Che eighth experimental run on Magnetic 
Tape 13. 
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Figure 1. Estimated Sink Rate Versus Altitude for Complementary 
Filter Break Frequencies, a * 0.6, I, 2, and 5 rad/sec 



Figure 2. Estimated Sink Rate Versus Altitude with Fllte' Break Frequency 
at I rad/sec* 0 and 10 Point Sink Bate Initialization, 
and Termination at Touchdown 


IT 


Involves the dynamics of the aircraft' estimation 

mate factor relationship wa- used as It Is a valid approxl- 

relatlve time scales of tha * * valid approximation In terms of 



•* • 

h + h 


u e 


(3) 


u is the airspeed of the aircraft 
T 0 ^ is the flight path time constant 

A number of methods of Implementing Eq. 3 were tried Theea i j j 
tlcal acceleration. * mated sink rate to estimate ver- 

celeI^^ 'vertical ac- 

celeration and estimated sink rate have high nolse-to-slgnal levels, with the 

worst being the vertical acceleration. m Eq. 3 t/ c-n he I 

weighting coefficient in the computation of p^tch ’att^Ld;. Eor tte 

rate This nmd / 1-8 times more heavily than the estimated sink 

rate. This produced a very unsatisfactory noise- to-slgnal ratio in the esti- 

mated pitch attitude. A possible solution to this problem might be to perform 

, .ad th, 

attU d ^ smoothing scheme before estimating pitch 

ttitude. These were postponed and the second method was tried. 

sink"'r:t:":;^rnuer^^^“;?!m"at?^^^^ T estimated 

a good candidate due to an aDoarent frp ^ Although this method seeraed 

noise (the noise taken as the hf.Kf """""" reparation between the signal and 
imagined as a smooth curve in Fie 2) oscillations about what can be 

the estimated pitch atuLe was^^n^^eptabl?' ^l^s 

Implicit in this method; and, in spite of^ the fnrl^! appears ^o be a problem 
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Neither of the attitude estimation schemes proved to be adequate thus were 
dropped for this study* It is recommended that^ in the future, pitch attitude 
be measured directly along with altitude and acceleration* 


Preliminary Data Analysis 


This section presents the results of the preliminary analysis performed on 
the data described in the previous subsections* The purpose of this analysis 
was to look at the data in some detail so that some initial conclusions could 
be reached about the pilots' control of the aircraft during the landing man- 
euver in the aircraft and the simulator. The Insight gained here was used as a 
basis for the detailed modeling described in the next section. 

Time Histories. Time history presentations of the landing data can provide 
certain clues about pilot actions and piloting technique. Consider the exam- 
ples shown in Fig. 3 for Pilot 432. Figures 3a and 3b were simulator landings 
and 3c was a check ride landing in the actual aircraft. Figure 3a shows a 
routine approach with attitude and sink rate maintained down to a nominal flare 
height of about ft. At that point the column was pulsed rearward at a 
fairly high frequency (about 7 rad/sec) in order to flare, and a reasonable 
touchdown sink rate obtained. In the next landing (Fig. 3b) a gentler and more 
consistent control column action was demonstrated with the flare starting some- 
what higher. The approximate frequency of oscillation was about 2.4 rad/sec as 
determined by the period over several cycles for both the derivative of the z- 
axls velocity component, fr, (l.e., proportional to angle of attack rate) and 
the control column. For an actual landing (Fig. 3c), the same pilot performed 
a comparable landing in terms of sink rate reduction, but the apparent inner- 
loop frequency of oscillation (which must be Inferred from vertical accelera- 
tion, h) was lower still, l.e., about 1.3 rad/sec. 

In order to gain more insight Into the flare maneuver, per se, (i.e., the 
flight-path trajectory), it was found useful to consider phase plane represen- 
tations in addition to time histories. 

Phase Plane Plots* Figure 4 shows the phase plane plots that correspond to 
two of the sets of time histories shown in Fig. 3. Figure 4a Is Pilot 432' s 
first simulator landing and 4b, the same pilot's second check ride landing. 
For the simulator case, a plot of pitch attitude versus height is shown along 
with the vertical veloc I ty-versus-height phase plane. Both the simulator land- 
ing and the flight landing show a phase plane trajectory which spirals Inward 
toward the origin. This final closure with the ground is reminiscent of 
second-order system dynamics according to such general control theorv texts as 
Refs. 10 and 11. 

One benefit of phase plane information is that effective response param- 
eters can be fairly easily extracted. Some examples are shown in Fig. 5. For 
a second-order system, the amount of damping is Indicated by the tightness of 
the spiral. Zero damping yields a continuous circular trajectory never coming 
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Figure 3 (Concluded) 

c. Second Check Ride Undlng Made by Simulator-Trained Pilot 432 



Figure 4. Phase Plane Trajectories for Typical Landings In the 

Simulator and In Flight 
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Exan.f>les of Phase Plane Trajectories for Various System Dynamics 


to rest (t.e., never arriving at the origin). Increasing amounts of damping 
force the response to settle In fe%(er and fewer cycles. In the case of a 
terminal maneuver such as a landing, the settling of velocity must be accomr 
pllshed In a fraction (less than 1/4) of a cycle. 

The natural frequency of a system Is reflected by the approximate propor- 
tion of elllptlclty of the phase plane, l.e., the relative extremes In velocity 
and displacement. For hlghlv damped systems, frequency Is related to how 
steeply the trajectory approaches the origin. 

Another feature of phase planes Is that they Indicate the nature of the 
response in terms of system order, nonltnearlt les, and mode switching. This Is 
an Important attribute for dealing with an III- or vaguelv-de fined system such 
as the pilot-vehicle combination. 

The airborne measurement of vertical aocelerarion was with reference to the 
aircraft center of j^ravlty. .Mtltude was recorded with respect to the radio 
altimeter antennv^> ^0 ft .^head of the Ceii* However it was not considered 
necessary to differentiate amonji height at the pilot, .at the eg, or at the 
radio altimeter antenna. Assuming a net pitch change of ^ vleg there would be 
less than a S ft dlsp.arltv which Is about equal to the uncertainty band in the 
flight data (e.g., Fig. . More precise data night deserve closer scrutiny of 
this issue, however. 


Flare Model 


The objective at this point Is to lav the foundations for the analysis of 
the flight and simulator landing data obtained in this experiment. Speclfl- 
callv a hypothesis for the manual landing maneuver is described which relates 
the combined pilot-vehicle response measurements, in flight and in the simu- 
lator, to the deliberate actions of the pilot. The scope Is Intended to 
include not onlv the psvehomotor behavior of the pilot but also the cognitive 
heh.avlor Involved In the pi lot ^s decision as to where to begin Che flare 
maneuver. 

Appendix A reviews some existing models of Che flare maneuver, considering 
their strong and weak points. These Ideas were taken Into account in con- 
structing a revised flare model. The next step was to describe fully the new 
model, showing how It better explains the recent Iv-acqulred landing data as 
well as encompassing pa ,st measurement s. The final step In this section wll' he 
to discuss .< number of performance metrics whlv'h arise from the new model 
formulation. These metrics will then lead to the next section which discusses 
the formal data analysis of all of the flight and simulator measurements. 

biased on the above cons I derat Ions , a model is proposed of Che flare man- 
euver which covers most, If no all, of the Important features no*ed both In 
prevlvuis models and In the existing data. ‘>ne important aspect of this pro- 
posed model Is Chat there Is no added complexity over the other models 
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discussed, in fact there Is significant reduction in complexity — so much so 
that a closed analytic form can be expressed for time histories of altitude, 
sink rate, normal acceleration, airspeed decay, and touchdown point along the 
runway. Furthermore It Is possible to descrll^ a clear role for the Important 
aircraft properties as well as for the pilot control law properties. This will 
ultimately aid In developing metrics for analyzing the landing maneuver. 

The theoretical development summarized In Appendix B suggests the 
following: 


• The flare maneuver can be described in terms of a closed- 

loop frequency, and damping ratio, 

• The pilot control strategy should involve the equivalent 
of height and vertical velocity feedbacks, weighted by 
gains k^ and k^, respectively 


• Various sources of lag or delay should be expected along 
with the basic airframe lags, T 0 and T 0 , contributed 
chiefly by surge and heave damping.^ 2 


Taken together, the above considerations suggest che following lumped-parameter 
model with four undetermined coefficients k^, , Tj, and k^. 



where ku is the pilot's height feedback gain, the lag time constant Tt subsumes 
all sources of pilot and airframe lag or delay , excluding the known flight 
path/alrspeed factor, T 3 , the lead time constant represents the pilot's 
equivalent vertical velocity feedhack-to-height lead ratio, and the gain k^ 
weights Che pilot's equivalent flight path angle feedback (in fact, any direct 
feedback of flight path angle or vertical velocity, l.e., k^ + Uk^ + «•.)• 


includes T 0 plus all other higher frequency sources of lag or delay 
associated with pltc?\ attitude and height control, viz., 

Tj • T^ + Z T^ > Z (2;/oj)j 

this simplification Is analogous to chat used for the pilot's neuromuscular 
actuation system In Ref. 2, p. 29, Fq . 32. 
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If the above lumped-paraneter model were to produce a second-order closed- 
loop response, then the following relationships must exist: 


FL FL 



0 + 


k' 




T / 


^ T 


L FL 


( 4 ) 


and 



( 5 ) 


Hence a data point plotted In the versus plane would have the prop- 

erties shown In Fig. ^ Note that for a single v-ata point (only two 
coordinates, ambiguity among k^, Tt , and and, 

as a consequence, k^. This can he resolved, though, if ensembles of landing 
data are considered. This matter will he reopened shortly when examining the 
ex: erlmental results. 


Fhase Plane Dynamics. As a final step In the theoretical development of 
Che landing maneuver inode I, the nature of the maneuver In terms of time history 
and phase plane solutions will be examined. This will be Important In the data 
reduction process presented shortly. 

Recalling Che general form of the second-order characteristic response from 
Appendix H: 


^ ^ -Sl"fL ^ -FL ^ ■ 


( 6 ) 


One can find the following solutions hy using inverse Laplace transforms: 
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h(t1 ■ -2a h(t> - h(t> 
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m 






and at touchdown, t 


0, h 


^TD> 


and h 


0 


(Note that In this formulation the flare begins at some negative value for time 
and runs until touchdown at zero time.) 

In view of the earlier stated preference for viewing the acquired landing 
data in the phase plane domain, consider the above analytic solutions in those 
terms. Figure 7 shows sink rate versus the flare-height/natural-frequency 
product both normalized by touchdown sink rate. This view provides some in- 
sight to the maneuver, namely, that the reduction of sink rate relative to the 
maximum sink rate is a strong function of damping ratio. A clearer picture of 
that can, however, be shown if instead the trajectories are normalized by the 
maximum sink rate. As Fig. 8 reveals, all of the trajectories are approxi- 
mately the same shape but stacked according to damping ratlo—and proportion of 
final sink rate reduction. If one last step is taken and the trajectories are 
superimposed (Fig. 9), then the following statements can be made: 


• The shape of the trajectory is mainly a function of 

• The proportion of sink rate reduction Is nainly a function 
of CpL 


These observations are therefore of considerable value in identifying the ef- 
fective closed-loop response parameters in the flight and simulator phase 
planes. 

In addition the normalized plot of acceleration versus altitude shown in 
Fig. 10 indicates that the peak acceleration In the final flare maneuver is 
approximately independent of damping ratio, l.e., that: 


max 


0.45 w, 


FL 


|h| 


max 


However the height at which h^^^^ occurs is a strong function of damping — soft 
landings have an early application of acceleration and hard landings have a 
late application. 
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NOTE: The peak normalized acceleration 

nearly independent of 
damping ratio 
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NuMrical Descriptions* A number of analytical relationships have been 
developed for describing the aircraft and the landing maneuver* At this point , 
It is appropriate to consider them In numerical terms which relate to the data 
being studied* 

Table I lists the aircraft model parameters which are representative of the 
DC—10 based on various sources and estimates* Mo formal description of the 
DC-10 was available p but the values should be considered reasonably accurate 
and applicable to the ranges of conditions encountered in both the flight and 
simulator landings. 

Perfonaance Metrics. The foregoing analytical development now can be used 
to devise several possible performance metrics which are relevant to the land- 
ing maneuver. Again, one Is Interested In not only the final touchdown 
condition but also in how It is achieved In terms of piloting technique* 

Table 2 presents a list of performance attributes of the landing maneuver 
together with their corresponding qualifications which play a role In 
determining success or failure, good or bad, safe or unsafe. Several 
corresponding metrics e:clst which can be applied to the landing maneuver* Some 
are based on control theory, others on subjective opinion. A general list 
applicable to a variety of piloting tasks. Including the landing maneuver, is 
also given In Table 2. Ca ’^rylng the sequence to a more definitive level, 
Table 3 then gives a set of various theoretical and empirical relationships for 
various metrics. Many of these are restatements from earlier sections of this 
report. 

One significant Implication of the above lists of task features and per- 
formance metrics Is that there are many ways to quantify the various aspects of 
the landing maneuver. Some parameters are more esoteric than others, but all 
have a degree of relevance depending upon one's area of lnterest--loop struc- 
ture, overall reppon^e, aerodynamics, etc. For example, the sink rate 
reduction ratio, would have clear meaning to the pilot. Instructor, 
or observer. The ratio can also be translated into a closed-loop damping ratio 
or Co phase margin in order to consider stability. Damping ratio. In turn, can 
be related to effective loop gains in order to consider perceptual pathways. 
Therefore It is not the intent to pick a **most-favored” parameter or metric, 
rather it Is to make the Inter-relaC lonshl ps clear and use what is most con- 
venient or meaningful for a given situation. 


RESULTS 

The results of the analysis of this training experiment are divided Into 
three main parts: 
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TABLE 1 


AIRCRAFT PARAMETERS* 

Type: DC-10-10 

Dimensional Data; 

Wins Area, S - 3861 ft^* 

Aspect Ratio, R - 6.8* 

Fuselage Length, Ip . 170.5 ft* 

Pilot Position re c.g. ■ 85 ft^ 

Tall a.c. re c.g. ■ 64 ft^ 


Mass Data : 


Average Gross Weight, W • 300,000 lb 

Pitch Moment of Inertia, ly - lixio*^ slug-ft^^ 

Aerodynamic Data (Landing Flaps); 

Lift Oirve Slope, C, • 4. 9/rad ^ 

*'*a 

Maximum Approach Lift-to-Drag ratio, (L/D) - 7 ^ 

Flight Condition : 

Average Approach Speed, 0 - 130 kt - 220 ft/sec 

Average Approach Sink Rate - 11.5 ft/sec - -690 ft/mln 

Estimated Dynamic Response Parameters From the Above Data: 

Heave Time Cbnstant, Tq * 1,8 sec 
Speed Time Constant, T 0 • 13 sec 

Phugold Frequency, u)p - 0.21 rad/sec 


* Ref. 12. 
f Estimated 
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TABLE 3 

THEORETICAL AKD EMPIRICAL REIATIOMSHIPS AMONG METOICS 


Closed^Loop Danplng Ratio, 




0.83 - 0.6 


(eaplrtcal fit Co aecond-order 
response aK>del — see Fig. 13) 


Closed-Loop Undanped Natural Frequency, 

■>t * (s«. Fig. 7) 


Where ih| Is Che virtual heighc to flare fro® 
oaxlnus sink rate to level flight 






(see Fig. 7) 


Where Is the virtual height Co make an s-shaped 
flare starting and ending In level flight (width of 
a phase plane half cycle). 


Closed*Loop Oaaped Frequency, b 




’Z~rr 

'FL 


(definition of daaped frequency) 


Helght-to-Attltude Transfer Function, (s) 


hy ^ 
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Airframe Response ParaoeCers 


J . hi 


(see Ref. 12 and Table 1) 


I' 


(see Ref. 12 and Table 1) 
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Plana ftajoctorloa 


fl»o starting point for tho data analysis Is ths sot of phass plans trajae- 
torlss for all of ths fllght^tralnsd and slnulator«>tratnsd subjaets. A 
cMp.ots sot of applicable phass pianos are provided for each pilot In a 
chronolugleal sequence. The plots are further classified, first according to 
the pilot a training background and, second according to the approxlnate good- 
ness of the landing In terns of touchdown sink rate. On this latter count, the 
landings wre divided nalnly on the basis of whether they eacsedsd 5 ft/sec. 
^call that the deslgn-llnlc touchdown sink rate of the DC-10 Is 10 ft/sec.) 

The pb«M plane trajectory classification will now bs described In nors 
apecific tarmse 

■nie plwse plane trajectories for all of the flight-trained subjects arc 
■'* ***•<= *’**»‘* ••rller. the only trajectories available for 
the rilght-cralned subjects were for the three NASA check ride landings— no 

training landings. The flight-trained subjects are 
further divided In terns of their apparent success. Group FA consists of all 

^1.*- pilots who doMnstrated landings with touchdown sink 

ft/sec or less along %rlth no obvious tendency to float or with no 
obvious height nlajudgnent tendency. (Ttoo landings in this group slightly 

► 4 consistent perfomance exhibited by the 

pilots Inwlv^ did not warrant exclusion.) Group FC, In Fig. 11, ars those 
subjects who did not fall within the landing criteria Just described. 

w- '<>*• thm slnulator-tralned pilots are shown In 

rtg. 12. Data for the training-phase siaulator landings are followed by the 

for the NASA check ride. (The actual landings ars saslly 
distinguished fr« the siaulator landings by the saoothneas of the alaulator 
trajectories.) The pilots In the slnulator-t. rained group are further divided 
Into three subgroups: SA, SB, and SC. As with the flight-trained pilots, the 

groupings are aade on the basis of approxiaate landing success for the NASA 
check ride. All of those subjects In Group SA deaonstrated touchdown sink 
rates of 5 ft/sec or leas and arc therefore coaparable with the fllght-tralnsd 
group, FA. Group SB consists of those pilots whose Initial check ride landing 
was In of 5 ft/sec but whose subsequent landings consistently laprovsd 

to a level of leas than 5 ft/sec. Group SB, therefore, exhibited soas degree 
of learning during the NASA check rids Itself, l.e., the trainees' first 
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•XDOtur* to eh« *ctu*l flight v«hlel«. Cto«p SC U coago^ ®f thOM 
$lattlatoT*tr«lM4 pilots who eoaalatsiitly ai^hltaS laarftnga la aataaa of 
5 tt/aac or oithtUtod othar uodaairaMa taa4oaatoa aooh aa axeaastra flaat« 
Hms Groop SC Is tha ala«laeor-traioa4 eooatorpart of Gr^ FC. 

To siaMartaSt tha grooptAga of ^ao plana trajoctorioa ato aaGa ftral la 
ftm of training haekgroua4 (l.o., fllghftralnod oataoa ala^ator-liaiaao) 
sad aacond la earaa of a roogh aaasoro of laadlag porforaaaeo. Thoaa gpoapiaia 
will bo eoawwkloat in tha awbsoooont locorpcotaeloo of roaiklta* 


Tha aaln data raductton proeodura appllad to tha phaaa plana trajoototloa 
was tha Idantlflcatlon of tha affaetlva aaeond-ordar raaponaa paraoatara, l*a.» 
tha damping ratio, , and natural fratoancy. Each of thaaa paraMtars 
MS sxcrsctsd Mnually using ths following guldss snd crltsrlma 


Sf factlva damping ratio can, ba .ralatad to tha ratio of tha touchdown sink 
rate”to tha maximum sink rata, h~/h^ 3 ,, as shown In tha pravlous saction. Tha 
chaoratlcal relationship shown in Pig. 13 was tha primary basis for axtracclon 
of affective damping ratio from the data. In most cases the phase plana tra- 
jectory features corresponding to maximum sink rate and touchdo%m sink rate are 
reasonably clear. for some landings, however, the maximin sink rata Is not 
obvious; and. In those cases, a cut-and-try match was made using special trans- 
parent overlays of second-order response trajectories. The estimated goodness 
of fit for Is *0.02 based on *0.5 ft/sec discrimination of sink rate. 


Tha effective natural frequency can ha obtained In a number of ways. '**'*y* 
possible, transparent overlays of trajectories such as those shown lu Pig. la 
ware used to match natural frequency. The portion of the trajectory fr» amja- 
mum sink rate to touchdown was tha most prominent feature matched. Tha 
staepnass of the phase plane during Che sink rate reduction Is, of course, 
directly related to natural frequency of the maneuver. In some cases It was 
possible to use the gross dimensions of the phase plane as they relate to an 
Ideal trajectory, l.e., the ratio of maximum sink rate to Che height at maximum 
sink rate. The estimated goodness of fit for ^ is *0.05 rad/sec basad on the 
O.l rad/sec Increments used for overlay templates. In general the precision of 
the matches is better than the dispersions in characteristics exhibited by tha 
pilots chmtolvtSa 


Table 4 lists Che Identified parameters for each case. Following Interpre- 
tation, these parameters provide one with reasonably clear Indications of the 
nominal piloting technique used during the flare maneuver, the effect* of 
training between the simulator and aircraft, and tha apparent simulator fi- 
delity for Che landing maneuver. 
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second step to analysing the landing data Is to consider common trends 
by Individual pilots or groups of pilots. This Is crucial to resolving 
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th« Mblgulty mmofig flight path faa^back gain, klg affactlva vartieal valoclty 
to^htight ftadbgek laad ratio. T*. and pllot-^vahlela lag. T«. dtacuaa^ 
tarllar. 

In thoaa fav eases vhsrs a single pilot perforasd a fairly large msiber of 
landings, a trend Is discemibls. This is illustrated in fig* IS* 

In all of the Fig* IS eases, there is a general trend vhieh fits the fores 


^^FL“n. ■ ^ ‘^t 


( 10 ) 


In fact, for three of the four pilots, this trend appears rather strong, and It 
can be therefore reasonably Justified in extending the lumped lag^lead model of 
Eqs. 4 and 5 to the landing data In general. The main Inference being made In 
doing so is that the pilot is adjusting the amount of effective vertical 
velocity feedback coesnensurate vich the height feedback~that the two feedbacks 
track one another rather than being independent. Such behavior 1$ equivalent 
to lead*compcnsated height feedback and is represented by the psrameter ■ T« 
in fig. 6 and in Appendix B, Fig. 32 and 33. Two consequent inpllcstlons or 
fig. 33 would be that only a height feedback is at work, perhaps with preview 
distance. R^. and that a vertical velocity feedback, per se. is not involved* 

Table 5 smmarizes the ensemble data analysis results for the various 
groups of Interest. 

Flloclng Tsehoiqus. In analyzing piloting techniv^ue. ue will focus first 
on those data which are most indicative of a skilled pilot familiar with the 
aircraft In question. The best set of data In that respect is considered to be 

for the flight*t rained pilots who exhibited reasonably good and consistent 

reductions In sink rates. Therefore Group FA Is considered as being most rep- 
resentative of exemplary piloting technique In the absence of other data. 

The performance Involved In the nominally good landings of Group FA can be 
expressed in various ways. The most common performance metric is perhaps 
touchdo%m sink rate, and Its cumulstlve probability distribution Is shown In 
Fig. 14. As Indicated, the distribution is essentially Gaussian with a mean 
slightly greater than 3 ft^sec. It should be recalled, however, that this 
probability distribution is somewhat conditional because the grouping was it- 
self based chiefly on sink rate performance. ^Nevertheless this will prove to 
he a useful point of reference with ocher groups* Further there la a clear 

tendency to achieve a moderate, positive net of sink sc landing thus avoiding 

both floating and hard landings. 

Figure 17 shows Che identified closed-loop parameters for each of the land- 
ings In Group FA. Voce chat most landings ranged in natural frequency from 0.3 
:o ri.5 rad/sec and in damping ratio from 0.55 to 0.75. The two landings having 
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lotted points represent iadi'/idual landings and line 
'epresents the linear regression of those landings# 


5# Snsesnlt Sinulatcr Data for Fc^or Indi^rLiaal Pilots 
Ha*/lng a Lsirge Nusber of Landings 





janoHO jjrm^ RnoiavA anj roiisiivxs HSAnaHvw nHinavi rranmas 











OnOlNAL PAGE^ 
OF POOR QUALITY 


daaplng ratloa of 0«9 inaolvad aubatantlal floating and as such should not 
naeasaarlly bo ragardtd as doslrabla* At chs othar axtrsna tha vary low daav 
tng ratloa eorraapondad to aoMWhat hard touebdowaa (with waloalcy f ft/Mc) 
for this t^oup. 

It la important to nota tha oparatlnt rangsa of Cn and wm damonatratad by 
Group FA< Thasa ara shown in tha cuaulatlva probaVllity plots la riga* 18 
and 19. First, Gp. appoars nemally dlstrlbutad ovar a ranga aittarally boun d ad 
by inaufflelant and axeasslva sink rata daesy. Shadad bewadarlas ara ahewi for 
slak'*rata*^acay ratios of 0.3 and 0.05 which, vhan appliod to a nominal ap- 
proach sink rata of 10 ft/sae, eorraapend to hi^ ■ 5 ft/sae at ona axtrama and 
0.5 ft/sac at tha other. 

A similar traataent Is prasantsd for data; however, tha distribution 
appears nora nearly uniform. The boundaries shown in this case arc the fre- 
quencies corresponding to overly-tlnid and overly-aggrasslve flare control. 

The lower bound corresponds Co a margin of about three times 1/Tg which is Che 
point at which flight path response Is cancelled by airspeed deca^. The hasard 
is Che loss of airspeed margin while, at Che sane time, not effectively de- 
creasing sink rate. Tha upper bound shown corresponds to airframe heave 

damping, 1/T^ . An higher chan about 1.5 1/T0 would Involve an attitude 
change without a comnMnsurate change In sink rate, l.e., Che point at which 
aggressive pitch control does not affect flight path. 

The FA-Group data arc olotted in "cschnique-ralated" terms in Fig. 20. 
From this it is possible t nfer how the closed-loop response is obtained or 
what are the effective pile, reedback gains. 

Along with Che individual landing data from Group FA, a curve corresponding 
to optloHim closed-loop damping ratio, ■ 0.7, and a linear regression line 
are both superimposed. According to the regression-line analysis discussed 
earlier, if we assume for the nonent that flight path angle gain k^ • 0, the FA 
pilots exhibit an effective lag (with l/T^ • 0.19/sec) and lead (with “ 1.9 
see) which correspond well to the optimum closed-loop damping ratio parabola. 

The effective lag observed with k^ ■ 0, T| ■ 5.3 sec, is substantially 

greater than the lags previously estlmatsd, l.e., Tg ■> l.A see (Table 1) 
and .T • 0.5 to I sec (as shown In the preliminary dati analysis). Renee the 
residual lag should be about 1.5 sec (the residual leg is not simply e 

summation but Includes higher order effects). If gain > 0, this residual 
lag can be > 1.5 sec. Vevercheleee, at 1.5 sec this residual leg is so large 
as CO auggesc chat the null hypotheais, k^ ■ 0, ia preferable. Retoluclon of 
the ambiguity in k^ and the sourct of this rsslduel lag must await chs 
collection of pitch attitude, pitch rate, end control displecement decs from 
furthsr flight and simulator casts. At Chs sams time this lag, whatsvsr Ita 
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Figure 19. Cumulati-re Frobaoillty of Closed-Loop Precuency 
for Skilled Pilots (Sroup PA) 
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Figure ^C. Closed-Loop Technique for Skilled Pilots (Group FA) 





aourc*, provides nssr-optiaua co«psnsstlon and should not bs eoasidsrsd as 
uodaslrabls. 

Ths Infsrrsd load eoupsnsaelon, of l.t sac for Group FA was also mar* 
opeiam. This appsars to bs ths priaarr "vsrtleal valoettp fsadhaek** a«eliaaiM 
and sugtaats that vartieal valoelep laforaation bs tlsd to Isad* 

ooapsnsaesd hsltbc psrcsptlon rachsr than threufh a aaparats visual or aocloo 
chsnml. It la poaalbla that such hsltht eoapsnsatlon dsrivos froa ths poo* 
astrteal propartlsa connsetsd with ths pilot's focus of attsntioa^ This is 
coaaonlp rsfsrrad to as a "prsvlaw distancs" and is suual to T. in this caso 
about 400 ft. ** 

An laporcanc aspect of the flats aodel arisss whan ona attmpts to da- 
coaposa tha affectlva lag-laad dynaaics Into raspactlva pilot atkl aircraft 
coaponants. As aantlonad above , tha effacti^ lag, Tj, can be attributed to 
various sources (alrfraaa Tg , pllot-vahicla , and a residual lag). If each 
of these sources Is taken t^ be an Individual ^flrst order lag or delay, then 

slaple first-order lead, by Itself Is Inadequate in producing an lapor— 
tant feature of the e^senble data results. Nanely, an Increasing pilot gain, 
kj^ (which increases produce the observed increasing In 

Fig. 15. To produce the observed relationship in Fig. 15 requires that the 

actual lead compensation be higher than first order. Thus the second-order 
lead possibilities suggested In Appendix B appear more likely. It should be 
noted that visual pathways alone (Fig. 32e In Appendix B) or a combination of 
visual and vestibular pathways (Fig. 32f In Appendix B) could fulfill this 
requirement for higher than first-order lead compensation. 

To summarise , then, in order to decompose the effective lag-lead flare 
model Into Individual pilot and vehicle components which arc consistent with 
the observed gain-varying features of the dynamics In Fig. 15, one must deduce 
that higher than first-order lead compensation is required of the pilot. This 
could conceivably be furnished by the visual perception model (Fig. 32e in 

Appendix B) suggested In Ref. 13 or by vestibular feedbacks (Fig. 32f In 

Appendix B) via the utricular system as suggested In Ref. 2. 

One particularly interesting feature In the piloting technique demonstrated 
In many of the actual landings (not only those of Group FA but for all subj- 
ects) Is the "duck-under" or "push-over" just prior to the flare portion of the 
landing. Figure 21 shows a typical case In which the landing maneuver control 
l*w behavior appears to begin at about 75 ft, followed by an increase In sink 
rate, and finally a flare beginning at about 50 ft. 

A SASA research pilot examining the data suggested that the duck-under 
tendency Is a natural and common action Intended to alter the point of touch- 
down (Ref. 14). This technique could be deemed appropriate by the pilot when 
following an electronic glide slope which Intercepts the runway at a 
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! conMrv«clv« distanct froa runway thrtshold* Additional diseunaion of thia 

I aanauvar can ba found In Kafa. IS and 16. 

Tha laplication of tha abova obaarvation ia chat thara la, in affaet, an 
outar loop acomd tha landing aanauvar loop atruetuia eoaaidarad thua far. 
That loop involvaa tha ain point ralaCiva to tha runway thraahold or touchdown 
aona. In tana of tha pilot aodal, it appaara that tha initiation haighc of 
tha landing aanauvar, h« > i* aalactad according to tha runway iatarccpc of tha 
noainal flight*^path9angla vactor. Thia unttld tand to axplain tha (dda varia* 
Cion la h|» in Che landing data. UbfortunaCcly aaaaurcaanta of height varaua 
distance along the runway axis ware not available. 

In order to lllustraCe Che general effect of flare height on touchdown 
point, consider Fig. 22. For noninal values of closed-loop response paraaeters 
and ILS geonetry, it can be seen how an increase in hp|^ above the noainal range 
of 30 to 40 ft tends to move the touchdown point closer Co Che threshold. For 
above 30 to 40 ft, in fact, the relationship between and hp^ is ap- 
proximately linear. 

The noainal piloting technique observed In Group FA pilots is summarized in 
Fig. 23 


Traloiag BffecCiveaess 


Training effectiveness Judged only on Che basis of overt landing perfor- 
mance can be misleading. For example. Fig. 24 shows the combined cumulative 
probability distribution of Che flight- trained pilots (Groups FA and FC) 
against those simulator-trained (Groups SA, SB, and SC). The difference, while 
discernible, is not particularly great. On the ocher hand, if each group is 
considered separately, then performance is more effectively partitioned 
(fig. 25) and each distribution appears fairly Gaussian. Moreover there is a 
simulator-trained group (SA) which looks nearly identical to the good flight- 
trained group (FA), and an inferior flight-trained group (FC), comparable to 
Che corresponding simulator-trained cases (SB and SC). This breakdown is, 
however, still incomplete without considering ocher aspects of performance and 
piloting technique such as are summarised in Che regression analysis depicted 
in Fig. 26. Hence Che following analysis will consider Che various performance 
and technique metrics discussed previously in conjunction with Fig.. 6. The 
inset in Fig. 26 describes again the theoretical Interpretation of each regres- 
sion line in terms of Che metrics of piloting technique represented by 
regression coefficients and in Table 5. 

The effects of training clearly favor chose pilots transitioning In the 
actual airplane of whom 77 percent (Group FA) demonstrated near-optimun tech- 
nique and superior performance. Two of the remaining three flight-trained 
pilots (in Group ^C) exhibited deficiencies in terms of aggressiveness In flar- 
ing and excessive lag or delay which they could not adequately compensate. Ihe 
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third FC pilot exhibited satisfactory closed**loop response parameters bat ap» 
peered to misjudge height during the flare* 

The Simula toftrained pilots showed varying degrees of diffieulties* Of 
those pilots, the best group (SA) comprised 47 percent of the total and was 
nearly identical to FA in terms of touchdown sink rate performance and in the 
amount of effective lag and lead compensation* the main difference urns in the 
lack of aggressiveness by most SA pilots which^ according to Fig* 27, showed up 
as a shift downward in the distribution of elosed*loop natural fregueacy* Tae 
constguence would be a greater loss of speed margin during the flare maneuver 
by SA pilots than with the more aggressive technique exhibited by FA pilots* 

For the remaining 53 percent of Simula tor- trained pilots (SB and SC) land- 
ing performance was substantially poorer with median touch do%m sink rates of 
5 to 7 ft/ sec and extremes In excess of 10 ft/ sac. Thasa two groups, origin- 
ally distinguished on the basis of improvement during the three checkrlde 
landings or the lack thereof, shoved a basic difference in piloting tech- 
nique* Group SB differed from Group SA in terms of more effective lag (T^)* 
Group SC exhibited vastly more of this same lag quality along with increased 
but nevertheless Inadequate lead compensation* It should be noted fron Table 5 
chat Che Group SB learning trend over the three actual landings was apparent in 
t~rms of the reduction in overall lag (increase in C^) and the increased amount 
of lead compensation (increased Cp to counter that lag* The second and third 
checkrlde landings for SB, in fact exhibit improved lag and lead coefficients 
roughly comparable to those of Group FC; furthermore SB's landing sink rate 
performance, per st, was saclsfactory (< 5 fc/sec). 

The effects of training for each of Che five groups of pilots are sun- 
narlzed in Table 6* Only Group FA exhibited consistency in all respects: good 

touchdown sink rate performance, aggressiveness in the flare maneuver, optimum 
compensation, and minimal effective lag* This group included 77 percent of Che 
flight-trained pilots* The **good" slmulacor-cralntd group (SA) included only 
47 percent of Che pilots using that medium, and while performance and technique 
compared favorably to PA, there was less aggressiveness shown in the flare by 
SA* Consequently a greater loss of speed margin could be expected during the 
sink rate reduction by SA. Inspection of individual pilots within SA did, how- 
ever, reveal five who exhibited proficiency in technique comparable to FA 
Cl*e*, oilots F418, F423, F424, F432, F439) • It is particularly noteworthy 
chat the one quality shared by the poorer performing groups (FC, SB, and SC) 
was excessive lag. 


Simulacor Fidelity and Validity 


The experimental results have important implications for (a) chs fldtlity 
of the training simulator In terms of adequate perceptual cues and consequsnc 
pilot behavior and (b) the validity of the simulator perfortaancc If cransftrrsd 
CO a flight situation* 
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Th« urn* analysis nachod usad for dotoralnlng control •trataty in tha ae~ 
cual 0C*10 was also applied to tha alawlator raeults. Dlffaraaeas batiiaaa 
alaulator and flight wars obaarvad froa direct eoapariaona uaing tha siaulator- 
trained pilots: Groups SA, SB, and SC. 

In taras of landing sink rate perforaanee. there ware alaad resalta ia 
taraa of direct flight versus siauXator coapariseas depeadtng :^aa tha fraap* 
As shoun in Fig. 28, all of the aiaulater^tratned pilots had ceaparahle stidi 
rata perforaanee in the siaulator ulth aadlaas in tha 6 to 7 ft/aec tuiga. 
Group SC aidiibited about the aaaa level of sink rate perforaanee in the aetaal 
aircraft, and Group SB was only slightly better. Group SA, hoaevar, a h e aad a 
substantial iaprovoaant In going froa siaulator to fli^t. Clearly the 
absolute value of siaulator touchdown sink rate was not a reliable predictor of 
In-fllght absolute parfomancs nor a aeans of discriminating pilot skill. On 
this basis alone, the simulator validity should, therefore, be considered poor. 

Taking the simulator versus flight results a step further, there Is a var- 
iety of differences tn terms of closed-loop perforaanee and Inferred piloting 
technique. Table 7 summarizes mean performance In terms of and Um and 
the ensemble lag and lead parameters which Imply technique, 1/Tj and T^. These 
results are also plotted In terms of the versus regression analysis 
solutions from figure 29. 

The chief common feature In all of the siaulator data Is the relatively low 
^FL* •'* i:*dlcated earlier, fhls. should necessarily correlate strongly with 
hard landings since the ratio h.jp/hg,g was used to determine In searching 
for a cause of the poor performance In terms of technique, two factors appear 
to be Involved: excessive lag, Tj, and Inadequate lead, T,. In the simulator 
Group SA had a very large effective lag although the lead was comparable to 
their flight value Und that of FA). Groups SB and SC exhibited both long lag 
and short lead In the simulator. 

In transitioning from simulator to flight, each of the three groups made 
substantially different adjustments. SA kept T^ about the same (already about 
optimum) and greatly reduced Tj to the correct value. Group SB did relatively 
little In the simulator to flight transition except to Increase Tj^ slightly to 
the correct level; T^ remained long. Group SC appeared to make an already 
large Tj much larger and to try and compensate by a largo but still Inadequate 


Thus the nature of the pilot compensation adjustments made by each group 
was fundamentally different except for a net upwards shift in the ver- 
sus .ip, regression line. Only in the case of Group SA did this shift yield 
good sink rate performance, however. 

Another feature of the simulator versus flight pilot behavior was the de- 
gree of aggressiveness shown In terms of or Group SB exhibited a mean 
■.>1^ in the siaulator which was comparable only to Xhat of Group FA; however, 
In-fllght SB regressed to the same less-sggreaslve ^ as the other groups. 
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TABLE 7 

SUratARY OF ANALYSIS RESULTS FOR SIMULATOR VERSUS FLICRT 



'fl 

(£Si) 

^ 2 
^aac^ 

a 

1/T, 

[ssi] 

V 

sac 

Rauarka 

Actual 00-10 

FA 

0.68 

0.42 

0,19 

0.19 

1.9 

RKgraaalva, vail 
coupanaatad 

SA 

0.70 

0.34 

0.12 

0.19 

2.0 

Lass sffgrasslv€p but 
wall coapansatad 

SB 

0.62 

0.36 

0.13 

0.12 

1.9 

Long lag 

SC 

0.60 

0.35 

0.13 

0 

2.8 

Vary long lag, ovar 
conpansated land 

DC-10 Simulator 

SA 

0.57 

0.33 

0.12 

0.05 

2.1 

Long lag 

SB 

0.54 

0.40 

0.20 

0.09 

1.5 

Long lag, short lead 

SC 

0.54 

0.32 

0.13 

0.11 

1.6 

Long lag, ahorc laad 


Th« invert* eh«racc*ri*ele la* Claa, 1/T^, la prtaancad bacauaa Ic la a 
principal conteituanc of th* ordlnac* of Ch* regraation line ahotm 

graphically in Fig. 26, wharaaa cha charactaristic lead tin*, T^, la equal to 
ch* alopa, C| , of ch* aaaw ragrasalon lln*. 



ORKIiNAL PAGE IS 
W POOR QUALITY 


A final ftatura of Cha simulator landings was an absanca of any aubttantlal 
"duck undar" tandancy such as nocad aarllar* This can bs obsatvad by dlracC 
Inspaction of Cha simulator phasa plana trajactorlas. 

Basad on all of tha f ongoing dlffarancas notad batwaan alsulator and 
flight, tha ovarall aasssamanc ngardlng simulator fidality auac ba Chat It wti 
daficlanc. Thara wars no substantial Indications that Cha gananl piloting 
tachnlqua induced In tha simulator was tha sama as that Inducad In flight. 
Furthanaon nona of tha various groups oparacad cha simulator In a way compar- 
able to that of Group FA, tha asaumad standard of good tachnlqua and 
perforaanea. 

The unsatisfactory piloting tachnlqua feature common to all simulator 
groups was excessive effective lag, T^. Therefore it seems wise to examine 
possible explanations. ^sed upon an examination of the previously discussed 
pilot-vehicle model of the landing, there are various factors which can appear 
as a system lag or delay. These Include: 


a Slow sampling of flight pnth changes and subsequent ad- 
justment of attitude 

• Low closed-loop bandwidth for pitch attitude regulation 
and control 

a Slow airframe flight path response (e.g., due to an incor- 
rect simulator mathematical model) 

a Simulator system lags or delays (e.g., in the visual 
display) 

a Pilot neuromuscular delay (which can be affected by simu- 
lator motion distortion) 

a Lack of direct vertical-velocity or flight path feedbacks 

a Combinations of any or all of Che above. 


The relatively large amount of effective' lag inferred from Che simulator 
landings suggests serious perceptual blocks which inhibit the pilot from making 
rapid closed-loop adjustments during the flare. The lags computed were sub- 
scantiallv greater than one might reasonably attribute just to simulator system 
lags or mathematical model discrepancies. As further evidence, the absence of 
a "duck under" for a terminal correction of touchdown point suggests a lack of 
or Indifference to low altitude visual perception of height, flight path, or 
distance along the runway, l.e., spatial perception in general. 
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Tht simulator doss appaar to ba supporting tha ganaration of affactiva laad 
coapansation* This nay ba a function of tha pilot salacting a suitabla **pra* 
viaw distanca,” that Is, obtaining haight at a distanca of Tr *U ahaad of tha 
aircraft (nofiinally about 400 ft). 


comamim uDum 


Tha airlina landing data analysad in this raport hava yialdad a rich var* 
iaty of results with iaplications in savaral araas including quantif ieatipn of 
piloting tachniqua, transfer of training using siaulators, and tha fidelity and 
validity of an airlina training siaulator for tha landing manauvar. Besides 
providing important quantification in these various areas, tha data hava also 
provided tha basis for a revised analytical modal of tha flare manauvar. In 
fact, tha modul developed seams to provide a reasonable explanation of the 
data. The model also helps to ej^plaln how pilots can complete successful 
flares and landings from a diverse array of initial approach conditions by 
adopting the appropriate degree of aggressiveness In control technique. 

Several metrics have evolved with regard to describing the landing man- 
euver. The first metric is the phase plane representation to characterize the 
flare maneuver, not only in terms of the ultimate landing performance but also 
how that performance was achieved: whether the flare was the result of a last- 

minute abrupt pull-up leaving no room for error or mis judgment, or whether It 
was the result of an exceedingly gentle decay in sink rate which m^ght be ac- 
companied by a large loss of airspeed prior to touchdoi/n. The phase plane also 
Indicates directly where there are dangerously high sink rates at low altitudes 
or if there was a floating or ballooning tendency. Pilot misjudgmenc of height 
is also discernible from phase plane portraits. The primary value .of the phase 
plane comes from the ability to portray two related states, i.e., sink rate and 
altitude, using a single curve. Use of time histories to present such informa- 
tion requires two separate curves. Time can be shown on a phase plane as a 

third dimension if so desired. 

Metrics which describe the effective closed-loop response and which were 

easily obtainable from the phase plane plots are the effective second— order 

damping ratio, and natural frequency, Closed— loop damping ratio can 

be obtained from the ratio of final sink rate to maximvnn sink race and, hence, 
is operationally meaningful. >latural frequency describes the abruptness of the 
flare maneuver and can be obtained from the curvature and steepness of the 

final segment of Che phase plane trajectory. Transparent overlays of phase 
plane trajectory families serve as a useful means of Identifying these closed- 
loop parameters. 

Metrics indicating the nature of the open-loop pilot-vehicle response can 
be inferred from ensemble analysis of Individual landings made by a single 
pilot or group of pilots exhibiting similar performance. One of these metrics, 
T|^, describes the effective lead compensation which can be expressed as a 
mathematical equivalent of vertical-velocity or flight-path-angle feedback. 
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The arount of lead coapensaelon can also be relaced to a prevlev dlscance from 
which the pilot obtains height lnfor«atlon. The value of the effective lead 
tine interval can be dlrectlr related to the regression line slope for ensenble 
landing data plotted In the plane. 

An effective pllot*vehlcle lag, can also be conputed using ensenble 
data and represents a variety of pilot and airfrane lags and delays. Two of 
the naln components are the airframe flight path lag, , and any effect of a 
flight path/pitch connand sanple*and-hold technique. 

Another aecric of interest la the degree of aggressiveness indicated by 
either Up* or ^ the latter of which is nore closely tied to the pilot's 

effective nelght gain, Ic^. 

Some metrics no longer hold the same degree of interest as they did prior 

CO this study. Most notable is the idea of a single, nominal flare height. 

The large number of flare trajectories shown in Che data suggest that there is 
no single preferred flare height, and the revised model demonstrates how good 
landing performance need not depend upon Initiating the flare over a narrow 

range of altitude. Instead flare height is better .ssociaced with an outer 

loop Involving the pilot's aim point along the runway. In effect, the flare 
control strategy is initiated higher or lower depending upon the amount of 
adjustment to the point of touchdown. 

An important aspect of the analysis performed here is the quantification of 
Che landing maneuver as it Is performed on the actual aircraft. This provides 
an Important baseline for examining the effects of training and simulator fi** 
delity. Without this description of piloting technique, one would have to rely 
far more heavily upon terminal landing performance (i.e., scoring of Che couch* 
do%m sink rate or distance along the runway) or on strictly subjective 
Judgments. 

The nominal landing technique Involved nearly optimum closed*loop paran* 
eters clustered about * 0.7 and 0.3 < < 0.6. Using ensemble data, it 

was found that • 1.9 sec and 1/Tj • 0.l9/sec. Such values of compensation 
tended to yield good touchdown sink rate performance over a reasonably wide 
range of flare maneuver aggressiveness. In order to atcain this kind of 
closed*loop behavior with the known or suspected leg elements, however, there 
is an implied necessity of higher than flrst*order lead compensation. This 
higher order lead compensation is possible through either visual pathways alone 
or a combination of visual and vestibular pathways. Furthermore the sane pilot 
control strategy evident In the flare could be associated with any pre*flare 
duck*under type of maneuver. 

There appear to be fundamental differences in the technique of pilots 
trained In Che landing on a flight simulator as compartd to cht technique of 
pilots ersinsd on ths actual flight vehicls itself. Those pilots trained on 
the simulator do not exhibit the sane degree of success as choss trslntd on the 
actusl aircraft. Of the thirteen flighc*crained pilots, all but chrte schitvsd 
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eensisttntly good Undlog p«rfonuae«. Only nln« of nlaoeooa •iaulocer-tnlaod 
pllett doaoastratod eesporablt touchdown oiidt rot* porfonMne«i Vat thaw aaw 
pilot*, on th* «v«r«s*, flartd l«*t aggrastivaly thu* inviting largar tpood 
lo«* during flaro. 

Th* l*s« suetossful flight* and similator*trainad pilot* all shar*d graatar 
aaount* of affoctlv* lag, Tj. In th* axtraaa* thi* lag waa, in part, eoapan* 
aatad by an ineraaaad but inaffactual load, T|^. 

Training slnulator fidality and validity did not appaar ada^uata to parfora 
corractly th* landing nanauver. Th* apaclfle diffarancas uara variad, hov- 
aver. In general, touchdown sink rat* coaparad wall between alaulator and 
flight only for those less successful groups of pilots. In all ea*a* th* pi- 
loting technique inferred fron slnulator results did not correspond to that 
from flight. The one feature conaon to all siaulator groups was excessive 
effective lag, Tj. The source of this lag could not b* isolated, however. It 
nay be connected with inadequate spatial perception near the ground, simulator 
system lags, mathematical model discrepancies, or a combination of sources. 

A number of recommendations seem appropriate in view of th* promise of this 
approach; even chough several questions have been answered, new questions 
arise. Ways to Improve analysis techniques are also apparent. 

The first recommendation is that, for future measurements of the landing 
maneuver, additional aircraft states, besides height and acceleration, need to 
be recorded. In descending order of their priority, the desired states are: 
altitude (radar~not barometric), normal acceleration, oltch attitude, cockpit 
control deflection, airspeed, rang* from th* runway, throttle, and pitch 
race. These data would offer a higher-quality definition of the outer flight 
path loops plus a description of th* inner control loops. 

Data reduction procedures should be Improved In two ways. Where data are 
sparse and noisy, as In this study, there Is th* need for improved data smooth- 
ing and estimation techniques. Such techniques are now available but are 
generally not convenient to implement. Th* second Improvement which should be 
insclcuted is automatic parameter Identification procedures. Th* landing man- 
euver model resulting from this study makes automatic procedures more 
feasible. Th* technique described in Ref. 17 would be especially suitable 
owing to Its ease of operation and undemanding computer requirements. 


Tn* analytical model development should be fully expanded to account for 
the higher-order pilot-vehicle system effects, some of which are described in 
Appendix B. \a mentioned earlier, th* landing flare model loop structure which 
has been defined is compatible with any degree of system complexity. It waa 
simply not possible to pursue a detailed analytical development which «*ould tie 
together aircraft stability and control, performance, flight control system 
features, atmospheric disturbance effects, and any ocher aspect which is 
dependent upon or related to the pilot landing task. 
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In a alaiUr v«in» th« Mdtl of tho Undlnft Mnouvor can and should ba 
txtondad to othor aircraft typta* Som caaaa aora critical than a jat traM*- 
port tncluda carrlar racovary of fifhtar/attaek aircraft, ahort«fiald oparatioa 
of pouarad*Uft aircraft, non»aviatlon ship racovary of halteoptara and VTOl 
aircraft, and, bacauaa of aoaatUaa liaitad aktll laaala, landlnt of lltht 
aircraft. Such analyata afforta vould first raqulra aceoapltahMfit of the naxt 
racoanandatlon, houavar. 

It is absolutaly asaantial that atudlaa of annual flight tasks tncluda 
actual flight aaasuranants. Additional flight aaasuranants should ha aada for 
eha casas studtsd involving pilots with varying lavals of skill. It is aost 
important to acqulra data for highly skillsd and srparlancsd DC-10 pilota in 
ordsr to Improva quantification of tha haaallns piloting tachnlqua paraaotors* 

With regard to pilot training, it is racoansndad that pilot control 
stracagy in tarns of assanttal loop dsvulopaant and coapansat Ion ba atudiad in 
conjunction with trai'^ing procaduras aid tachniquaa. In this study tha 
analysts lacked anv intimate knowledge of how flight Instructors Intsractsd 
with subjects and how such intaricticn affected piloting technique 

deveU>pment« It U now feasible consider on-line moni’^orina of pilot 
psychomotor and cognitive hehav:or along the lines demonstrated. Such 
monitoring could he of direct jse to Instructors as well as to the evaluation 
of instructors or evaluation of Instructional techniques. 



Perceptual pathwavs — thel r use and their dynamics— require far more 
studv. While the overall pilot-vehicle response In the landing maneuver Im- 

plies the adoption of certain effective feedback loops and compensation by the 
pilot, their specific nature is not necessarily clear from the limited 

measurements availahle In this investigation. It can only be hypothesised Chat 
visual pathways mav ^e more llWely than vestibular ones and that pilot 
generation of the observed lead compensation by Judgment of height involving a 
preview distance mav he more Itkelv than by a flight path angle or vertical 
ve loci tv feedback. 


^Inallv, It Is recommended that simulator training for the landing maneuver 
not he assumed fullv c^rlvalenc to flight training without careful study of 
essential loop development. ‘'f course, simulator training should not he 
discouraged. Father, there should be strict accounting of the piloting 
technique developed on the simulator versus that required for flight. Where 
piloting technique deficiencies are noted, then remedial measures should be 
taken. 


Ames Research Center 

National Aeronautics and Space Administration 
Moffett FUld, California 9403? 

JuLv 
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I ■•view of lorllor Ibtelo of tho iMiiof I fcoo w oo r 

Tho Undlnf flaro is rsgordod os tKs erteleol flight phoM «nd hot boon 
studied by o nuabor of rosoorehors. A mmbor of asosuroaonts c( touchdown 
poraaotors such as sink rats and touchdown point hawo boon aodo without any 
particular regard for tho specific pilot behavior involved. In a few eaaoa» 
however, analytic aodels of the flare aanouver have been suggested and these 
were worth reviewing In order to revise the oodellng hypothesis which was ap- 
plied to the data acquired in this experiment. Some of the questions 

Include: Ce) Is the maneuver chiefly open loop or closed loop? Ch) Is the 

maneuver segmented or continuous? and (c) Are the perceptual pathways used by 
the pilot mainly visual, mainly vestibular, or both? 

It is tempclng to treat the landing maneuver as a segmented multistage 

process In view of Che apparently different actions which take place over the 
entire time fratM of the landing. References IS and 19 describe a modal which 
Is representative of this segmented maneuver point of view. In effect Che 
landing Is broken Into three phases following the final approach. Phase 1 
consists of the Initial flare to reduce Che approach flight path angle to es- 
sentially lero and terminates 5 to 10 ft above the ground. The second phase is 
called the float and consists of easing of the airplane down from the 5- to 

10-ft height, accompanied by reduction of thrust to Idle. Finally the third 
stage Is Che touchdown itself and is characterised by the Impact sink race and 
the structural loads thus Imposed. The stated purpose of this kind of break- 
down of the maneuver was to aid In identifying critical pilot actions and 
sources of Inaccuracies In the flare. At the same time, this model Implies 
chat Che pilot Is, In fact, shifting from one mode of action to another for 
each segment. A cleaner model would involve a unified set of control laws 

which still produce she actions Just described, yet without any particular 

segmentation of behavior required. 

The model in Ref. 20 describes the flare In pilot-centered terms rather 

than Che trajectory terms of Che previous model. In effect the pilot Is con- 
sidered to close a feedback loop around sink rate which is initiated at a 
preicrlbed flare height. This kind of flare law yltlda an exponential decay of 
sink race or. In terms of a phase plane, leads to an esaanclally scralghc-lina 
segment for sink race versus altitude following flare Initiation. The form of 
this model Is useful because It shows how the pilot can perclclpate as pert of 
a closed-loop system In what Is known to be a highly critical flight phase. 

This particular node! also consolidates at least two of tht segmants proposed 
In the previously described model, l.e., Che Rhese 1 flare and the Phase 2 
float. Thara Is, howaver, believed to be an assenclal element missing In the 
specific command loop structure suggested, thee la, an outer loop feedback of 
height. Without height feedback, landing performance depends greatly upon both 
prtclse flare Initiation height and a sink-race-decay time constant. This 

leads to Che third model to be discussed. 
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«*rc«i« NMfieltl nsulet U d«- 
#t!i^ i «ltttud« M ttw ouur loop ie a BUofeo«€oro4 

dl«incT^Jlo..7iL •" loop ta etet ehi^tra 

dlatlnct eloaad-loop profaranet for altituda. Ntnea chart la tow dotroo of 

Hollht. TM* oould Aoe ha eht eaaa'la cho 
aodol aanelonod pravloualy. Any orror In flora inielaeloa would hava a dtraet 

l^et on couehdowR aink rata or candancy co float. Ihta ta 

?!!!!!!!. it'^v®***"** olHeoJa to laftwaiiea eantrol 

cooMn^ la at tha porcalvad flora halfht. Tho alcltuda eoMond loop aodal 

^acrl^ In chla third eaaa alao Involvaa uaa of a noolnal flora holpht and. 
whlla touchdoM condltlona art aora tolorant of flora halght alaeua than thi 

ir'^Bavlr^h^t^’ for cha pilot to cue on a noalnal flora halght 

lira lVVh.r*rV"Vi troubla*o«« aapact of chla third 

flara aodal In that tha flara coaaand to cha cloaad-loop block dlagraa la not 

!rVhi'“ "T^ oltltuda. A Utaral IntlrpraCatioS 

of this modal would aay that tha pilot 1$. In fact, attamptlng to eloaa an 
altlt^a loop about tha flare halght and this does not saem agrae with tha 

be dlicarded'^^"* ®®^*l described In Ref. 8 should 

»'«"«rlted In Pig. 30. offers some Imnortant no- 
'* r""' tha landing maneuver but none of these 

a s«lsfyin,a description of cha pilot behavior which covers all 
There are also features of the new landing data which force 
consideration of some additional requirements for a flare model. Most impor- 
tant or chase Is that there does not appear to be any particular preference^for 
nominal .lore altitude even thoueh the airline flight manual CRaf. ') gives a 

7'"** ^7 flare Initiation. ,\s shown In tha data, tha flare cra- 
Jector/ begins as low as the nominal 30 to iO ft suggested bv tha flight manual 

ZJT ■" t. 

C?!?a . I 7 formulate a model of the flare maneuver which could 

hare inltUtion'^ reasonable touchdown sink rates regardless of the height of 

features which should be consolidated Into a revised 
^od€ I of ch« .Itirc rnaneuver ar«; 


• Evidence of the three distinct phases of the landing man- 
euver including flare, float, and touchdown 

• A pilot-centered description which relates the resulting 
trajectory to the pilot-vehicle dynamics 

• A capacity to manage or regulate sink race 

• A preference for height relative to the decrease In sink 

rate 

• A tolerance for a wide range of flare initiation heights. 
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^ aeco«>d.tlon of pilot •cclotit aatoelatod with 
point on IIm runmp althou|h this sspset Is soMwhst bs- 
yond ths scops of ths sxpsrlnsntsl dsts obtslnsd. 

Mow eonsidsr s nu■^sr of flars control strstsglss tsksn In a nnsrle ssnss 
which can bs studisd In tsnos of ths lapllsd pilot control laws and ths rssult- 
g ynM c response sspselally In tsras of a phasa plans trajsetory. This 

vortical translational dsgras of frssdoa and 
nsglects ths alrspssd rssponss aapsets which ars known to bs hlghsr-ordsr sf- 

asm that a partitioning of rssponss Is In ths s-axls and x-axls of ths alr- 
craft). Ths analytic approach could, of course, be extended to additional 

degrees of freedom if they were believed to bs important. 

iifflrTnl Strategies which would yield 

differing kinds of flare maneuvers. Each of these flars types is. strlctlv 

shaking, closed loop In some respect. For example, the angls-of-attack- 

ofTt"tlck the pilot Is commanding a desired angle 

oLtlcuSr ^ insist of either a step or ramp command beginning at a 
particular altitude. The »-comnand would also be representative of a control 
column command where the short period response of the aircraft Is sufficiently 

landlngT^ response (this would usually be the case In the 


wm.ir'L attitude command flare (3-comraand) also assumes that the pilot 

altl^ud^ Tre "Lt attitude change at a predetermined 

_ ! . ■ ^ ^ there is an exponential response mode not 

tirt-Ll a '^’■^“her this response mode corresponds to 

.nd .t“ ..^/c r’.cll '*"* ‘“'“"d 


anni?'* norwl acceleration conunand flare (h-command) assumes that the pilot 
tliliV command In normal acceleration at a given flare 

.ipS.';oJiL*5u4 «’• »»• «• th. 

roreli^r^ln.‘d'to*''J/”'”V. ^ commands 

1 predetermined touchdown sink race. The value for the exponential decay fsc- 

pn« looTgsln on 7”k r^^.T" ' •"<* the 

f^P* the so-called altitude command which involves a 
preference for bofh cltltude and sink rate. Mormally h would be equal to ztto 
(the ground) and h for most aircraft, would be nearly %ero. 
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TlM«r*tic«l Iasi* of P royoo oi nioi 'V4%lelo Motel 


The ehcoretleal betls for the revised pilot-vehicle oodel of the lendint 
flare Is the assuaption of e predoolnently tecond— order eherseterletle 
response, which Is strongly suggested by the phase planes constructed froa 
flight data. This laplles the hooogeneous or characteristic equation: 



h + 




h + 


2 

“fl 


h 
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It Is further assuraed that this characteristic equation Is associated with a | 

pilot-vehicle system having an altitude command loop (cuter loop) and that the j 

flare maneuver corresponds to the response from an Initial offset with respect ] 

to the teminal conditions (l.e., from an initial altitude and sink rate)e j 

Thus, analytically, the flare is regarded as an unforced response from a set of ! 

initial conditions to a set of desired conditions at couchdovm* * 

j 

In considering the pilot control law implications of a second-order | 

characteristic response, the first step Is to examine the aircraft equations of \ 

motion, especially with respect to altitude. The complete longitudinal | 

formulation (described in Ref. 17) can be simplified to a second-order, slngle- 
jxls perturbation fon: 



( 12 ) 


Where is the dominant first-order lag time constant between 
2 a pitch-command, and flight path »*esponse, 

and Ta is the dominant first-order time constant associated 

with airspeed response. 


It can be ^»hown that for operation at or near maxlaun lift-to-drag 
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the phugold natural frequency squared 
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It la Instruct Iva to note that tha airfraas-alono flight path lag, , can 
ba axpraaaad In tanaa of gross walght, W; apaad aargin abova stall, IM; a^ air 
danalty, o; along vlth tha eonfiguration^apandant paraaatars: oaxlaua lift 
coaffleiant, ; wing araa, S; and lift curva alopa, , i.a., 
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max 


yp^g IM 


03 ) 



Thus operationally Che aiaounc of flight path lag depends on the square root of 
gross weight* 
loadings* 


Hence there is only a small T0^ variation over a normal range of 


Inference of Pilot Control Strategy 


The approach used to Infer piloting technique In the landing maneuver was 
to examine the experimental results for the difference between a fitted 
differential equation describing the observed closed-loop notion and a 
theoretical differential equation describing the known effective flight path 
response of the basic airplane to changes In pitch attitude. The difference, 
assanlng negligible atmospheric disturbances, should be the effect of pilot 
actions and could be Interpreted literally as a pilot control law for pitch 
attitude, l.e.. 


minus 


(fitted differential 

h ^ ^ ^ ^ ^ equation (14) 

of landing maneuver) 


h + 




+ 




(Aircraft flighty, e\ 
path equation) ^ ^ 


equals 
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V ^ (inferred pilot 
^ control law) 


( 16 ) 
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Rearranging the result, we obtain 


— S"’ 




8 - - kh b - h 


Hence the effective control law for pitch attitude should Involve an «“*ctive 
feedback of height and vertical velocity. This can be easily seen In graphics 

terms In Fig. 31* 

The main value in Che above analysts technique Is In gaining an apprecia- 
tion for rtLtJve magnitudes of the various pilot and vehicle features at work 
li ”h. landing «n.«.et. Crt.ln cn.plln.tlon. and U.lt.etnn, should b. ran 

ognized, however. 

First there are several of possible ways for Che pilot to exhibit ^he ef- 
fective heleht and vertical velocity feedbacks, \ and k^. In fact there could 
feccive height and vertica "involving various perceptual 

p:thlavTor iei« of compensation. Figure 32 shows six possible ways In which 
Tvertlcal velocity equivalent could be established and c^pl^ wl J a he^^t 
feeHhApic The first assumes direct visual perception of vertical 
Either from motion of subtended angular features (e.g., the '"ir^o^'at’l'ona’ 
foatures which ace eransyersed to the 

•VnaTantaneVA 'light path angle which can o 

";i;^y:^:ry.;l.'ryrnro^“":^d'W.i^^^^^^^^ 

Involve the pilot-centered generation of a height time 

WZl ^;;ocer^rn“roiM;atir wftt^\hr?lr::rxri ‘^Irceptlon of altitude; 
the fourth, a geometric construct based on a preview distance, R,,. Ih 
visual field where Che pilot is deriving height Information. 

4 fifth case Involves Che pilot-centered generation of second-order lead 

curvilinear landing flare (where the focus of expansion ^**^*[*^ 

wheJ:^iie"“5irot Vs dV;”“JVlght* in^rrm^lon. The ’ln.?;ntaneou. 
rir«tlo; Vf ^h. Jllght^ath in the verflcal plan. In this case Is given by the 
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tuo (curvllln««r) str««mrs which btcoa* horliontal in thn nod 

peripheral visual fields. A leneral eodel for this type of visual field 
loforaaeion In horlsontal curvilinear flight Is presented in Raf. IS. Several 
possible sources of lag or delay In establlahlng a cbaiv In the attitude 

will be discussed subsequently, rioally, a sixth possibility would be an ac- 
celeration- and/or veloclty-llka feedback based on vestibular perception of 
specific force to reinforce the caeq>enaatlon of visual cues free any one of 
cases s through s In Fige 32e 

other coepllcatlng factors Involve the presence of additional sources of 
lag beyond those associated with short-tern flight-path responsa (T^ ) and 
longer-tera flight-path/airspeed response (Tj or »p). One known source of 
additional lag Is the closed-loop response of >ltch attitude following a pilot 
conownd. As a rough approxlnation to the net effect, the Inverse closed-loop 
bandwidth for pitch control, 

lag, Tg . The goodness of this kind of approxlnation depends upon the spectral 
range o? Interest (relative to I/T 9 and and the amount of spectral sep- 

aration (the approximation is fairly^ good for frequencies at or below l/Te^ so 

long as > 3/Tg ). 

^6 2 

Another source of lag could be In the pilot's deciding to hold or change 
the pitch attitude command Itself. If we had a tine history of pitch attitude, 
this effective lag would be manifested by the degree to which the 
aperiodically "stepping” pitch attitude during the flare. There are indlca* 
tlons froe other sources (Ref. 19) that pilots will apply an Initial step in 
attitude to start the flar**, pause to see the effect on flight path, then apply 
subsequent attitude steps. This would resemble a sampled-data process, and the 
consequent lag or delay would thus be associated with the pilot s cognitive and 
psychomotor processes in commanding pitch sttitude. 

A sunsry of the lending model maneuver including the components discussed 
above Is shown In Fig. 33. It will not be possible to Identify precisely the 
various faaturss labelad in Fig. 33 due to tht limitations of the data avail- 
able. It will be possible, however, to derive certain insights based on the 
nature of "equivalent system" paremetere which lump togathar the 
vehicle characterlaticf juft Identified. This equivalent system ^el Is 
presented in the main text of this report under the topic entitled Flare 

Modal." 
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